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Markovian type of memory is considered as an inseparable ingredient in a variety of natural two- 
state processes within a vast range of interdisciplinary fields. The Markovian memory embedded 
in a binary system is shaping its evolution on the basis of its current state. In doing so, this type 
of memory introduces either clustering or dispersion of binary states. The consequence is directly 
00 ' observed in the lengthening or shortening of the runs of the same binary state and also in the way 

' the proportion of a state within a sequence of state measurements scatters about its true average. 

, In the presence of clustering, this scatter will become broader. Conversely, it will become narrower 

■ when dispersion of states is present. Both trends are directly quantifiable through the Markovian 
self-transition probabilities. It is shown that the Markovian memory can even imitate the evolution 

^ I of a random process, regarding the long-term behavior of the frequencies of its binary states. This 

. situation occurs when the associated binary state self-transition probabilities are balanced. To ex- 

emplify the behavior of Markovian memory, two natural processes are selected from diverse scientific 
disciplines, belonging to a wide range of systems classified as two-state systems. The first example 
is studying the preferences of nonhuman troglodytes regarding handedness. The Markovian model 
in this case assesses the extent of influence two contiguous individuals may have on each other. The 
' other example studies the hindering of the quantum state transitions that rapid state measurements 

, introduce, known as the Quantum Zeno effect (QZE). Based on the current mathematical method- 

■ ology, simulations of the experimentally observed clustering of states allowed for the estimation of 
the two self-transition probabilities in this quantum system. Through these, one can appreciate how 
the particular hindering of the evolution of a quantum state may have originated. Namely, through 

C/3 . a quantifiable degree of preference for the same binary state combined with a quantifiable degree of 

avoidance of the rival state. The aim of this work is to illustrate as merits of the current mathe- 
matical approach, its wide range applicability and its potential to provide a variety of information 
, regarding the dynamics of the studied process. 

m 

O ■ INTRODUCTION 

cn , 

Markov sources provide phenomenological representations of a wide range of natural processes. In a Markov 
, chain involving state measurements, the system under observation experiences state transitions according to specified 
probabilities. A specific class of Markov sources are the two-state systems, frequently employed in physics on a 
multitude of occasions such as to represent spins in the Ising model, or the outcome of particle collisions in the Galton 
^ ' board binomial experiment flj . Binary systems can also represent sequences of quantum measurements, as in the case 
, of the quantum Zeno effect (QZE), where the natural evolution of the two- level atomic system is hindered by rapid 
^ ' observations [2 J3. Moreover, binary systems are often encountered in electronic soHd-state diffusion i, turbulent 
5^ , flow dynamics HjajQi bistable liquid crystal displays Josephson junctions or flip-flop electrical circuits 

in computing machines, which fit well as types of two-state systems [l2j . Binary Markov processes can, therefore, 
describe adequately a whole host of physical micro- as well as macro-systems [isj . 

Yet, two-state systems are not only pertinent in physics and computing, but also highly relevant to probabilistic 
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systems commonly studied within the medical and social sciences. It is customary, for instance, in medicine [14| . 
psychiatry [l^, or anthropology to test a hypothesis against two alternatives. In medicine, the effect of a drug 
treatment is decided from the proportion of successes (against failures) across many independent studies. While 
the degree of reliability of the results depends on the trustworthiness of the database, specific tests are designed to 
determine whether the database is free from biases. One such mainly visual test is the construction of a scatter plot of 
independent results that constitute the database • If the distribution of a large number of data on the scatter plot 
appears asymmetric, it implies that the database is biased by, as an example, publication biases and thus rendered 
inappropriate source for reliable statistical inferences regarding the studied effect. Less emphasis has been sited so 
far on the scatter plot's breadth and the information that it can provide concerning the dynamics of the underlying 
mechanism. The relationship between them, however, can be exemplified on the basis of two-state Markov processes, 
as will be shown in this work. 
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Markovian memory is introduced by the requirement that each new state depends on previous states some n steps 
back, so that past probabihties determine the future ones [H, [l^l ■ As it is discussed here, the dynamics of two-state 
systems fall under two specific categories of Markovian memory, which either introduce a clustering or a dispersion 
of binary states. 

The purpose for the application of the Markov memory approach is to study the first-order interaction dynamics in 
a variety of two-state systems. In doing so, it can estimate the conditional likelihood for the system to change state 
or remain at the same state. It also estimates the consequent lengthening or shortening of runs of the same state in 
a sequence of state measurements. 

A brief description of the two-state Markov process is offered in section 2. The statistics of Markov chains in relation 
to the clustering of states (lengthening of runs) and dispersion of states (shortening of runs) is discussed in section 3. 
Two applications of the mathematical approach implicating Markovian memory, in physics (QZE) and anthropology 
(Handedness) are presented in section 4. A more detailed analysis of the present mathematical treatment is provided 
in the appendix. 

FIRST-ORDER, TWO-STATE MARKOV PROCESS 

A first-order, two-state Markov process is driven by four transition probabilities, pij, i,j = 1,2. The sequence 
of measurements of the binary state, Xn, represents the occurrence of an event (state A), otherwise exemplified 
by Xn = 1, or the failure of its occurrence (state B) corresponding to Xn = 0. The initial absolute probabilities 
of finding the system at either state A or B are pi and 1 — pi, respectively. Once the system is at state A, the 
conditional probability that it remains at the same state after a single measurement is pn ~ p, whereas the conditional 
probability, p2i to make a transition to B will be 1 — p. In a similar fashion, probabilities P22 = q and pi2 = I — q are 
assigned to transitions from state B. In both cases, the self-transition probabilities satisfy the inequality < p,q < 1. 
Whereas p,q = 0.5 underlines random variability of state measurements, the range of probabilities 0.5 < p,q < 1 and 
< p, (7 < 0.5 introduce persistence of the same state and anti-persistence, respectively. The latter case implies an 
increased probability to avoid transitions to the same state over a sequence of measurements. We shall next discuss 
how the expected frequency of the one state of the Markov process (A), in a sequence of n consecutive measurements, 
depends on the self-transition probabilities p and q. 

The average frequency, Pn, of occurrence of state A in a Markov chain of n steps is [l^] 



, Pi - P 1 

Pn = P H 7 

n 1 

The parameter a 1 is 



(1) 



a^p + q-1 (2) 

After a large enough number of state measurements, n, (Markov transitions) the frequencies of observed states A 
and B become p and 1 — p, respectively, at any value of parameter a, a ^ 1. 



lim p„ 



l-q 



2-{p + q) 



If p = q, the frequencies of observed states A and B become p ~ 0.5 and 1 — p = 0.5. This result holds true not 
only in the absence of memory when p = q = 0.5, but most importantly, when p ^ q ^ 0.5. This is a curious condition 
which turns a Markov process with memory into a random process, as far as the long-term state frequencies p and 
1 — p are concerned. 

Even in such an odd situation, the non-randomness of the Markov process is directly observed through the variance 
of the binary state in the sequences. The standard deviation of the expected proportion of binary state A, pn, is 
estimated to be |2(| 
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Relation (4) is also written a — ao ■ i^, where (Jq ~ ■\/p(l — p)/n, is the standard deviation of outcomes of a 
memory-free Markov process and it indicates that the variance of pn can be modulated by a factor 1 introduced 
by the Markov self-transition probabilities p and q. Assuming p and q ^ 0.5 the factor which modulates the variance 



2 P + Q 

A large variety of natural processes can be represented as Markov processes. In such cases the characteristic 
parameters p and i'^ can be assigned accordingly. These provide insights into the process dynamics on first neighbor 
level. Often a process is studied through its statistical behavior with the help of meta-analyses. In such approaches, the 
two characteristic parameters, p and v^, can be easily estimated through the so-called scatter plots. The application 
of the Markov process on such statistical ensembles can provide useful information on the investigated process as will 
be shown next. 



SCATTER PLOT OF MARKOVIAN BINARY STATES 



The combination of results from independent studies of a phenomenon constitutes the so-called meta-analysis. The 
accuracy of the result of each individual study depends proportionally on the size, n, of the study, since the associated 
error is inversely proportional to the square root of the standard deviation. 

The scatter plot, n = f{pn), where the size of studies, n, is plotted against the associated proportion of binary 
state, Pm will be shaped like an inverted funnel [2lj centered at p, the single true average, or in other words the value 
to which the averages Pn converge. This is due to the fact, as mentioned above, that the estimate of the underlying 
effect becomes more accurate as the sample size of component studies increases. Scatter plots can thus provide useful 
information not only on the magnitude, p, of an investigated effect, but also about the dynamics of the mechanism 
involved p^ . 

The frequency of state A, ^fn, in a sequence of n individual measurements of a Markov process will range within 
a confidence interval. The 95% of them on the scatter plot are expected to be enclosed by the confidence interval, 
represented by the two funnel-shaped red curves in Fig. 1, = /(n) or n = f{pn) 



Pn = p± 1.96 ■ 



p(l - p) 



(6) 



and 



n^3.84. ^i^-^);f (7) 

ypn - pY 

Computer-simulated Markovian data sequences of size n were generated and plotted against the frequency of binary 
state A, Pn, in each sequence. Fig. 1 illustrates two such examples; (a) one of a symmetric {p ~ q) Markov process 
exhibiting anti-persistence, p,q < 0.5, and (b) of an asymmetric (p ^ q) Markovian process with p = 0.88, q ~ 0.5 
exhibiting one-sided persistence. In the symmetrical case, p = q, the correlation factor Cm between the two states in 
the Markov chain 

1 ^ 

C„i = lim — SnSn+m (8) 

N^QO I\ ^ — ^ 
n=l 

becomes the assemble expectation value of the correlation between first-order neighbors [2^ 
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FIG. 1: Scatter plot of Markovian data. Dots: computer simulated data, Lines: 95% confidence interval, (a) Solid lines: 
Symmetric Markovian process, p = q — 0.12, v — 0.37 and p = 0.5. Probabilities p,q,< 0.5 introduce anti-persistence and 
v < 1 introduces dispersion of states and narrowing of variance. Dotted lines: memory- free binary process, 1^ = 1. (b) Solid 
lines: Asymmetric Markovian process, p — 0.88 and q — 0.5, u — 1.49, p = 0.81. The persistence introduced by the self- 
transition probability, p, of state- A, introduces broadening of the variance {ty > 1), according to relation (4) and as compared 
to a Markov process with p = 0.81 and u — 1. 



Ci =< s„s„+i >=2p-l (9) 

When p = q = 0.88 the strong, positive correlation of neighbors (CI — -1-76%) introduces persistence and therefore 
clustering of states, while the condition p = q = 0.12 introduces strong negative correlation, anti-persistence and 
dispersion of states (CI = —76%). The graphical representation of Fig. 1 confirms that the simulated Markovian 
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data obey well the statistical estimations: the 95% of them were found enclosed under the two 95% confidence interval 
curves, Eq. ([7]) , suggesting that this statistical tool applied on scatter plots of meta-analyses is relatively reliable. 

The modulated variance, as described above, indicates absence of random variability in independent measurements 
of an effect . This type of observed irregularity within a meta-analysis has been referred to by the term " statistical 
heterogeneity" [1^. There are numerous reasons possible behind statistical heterogeneity in a database. We consider 
here the two types that generate either dispersion or clustering of Markovian states. 

Looking closer at the shape of the plot we notice that, according to Eqs. (|4]) and ([5]), when > 1 its scatter 
becomes broader at all sample sizes n, as compared that of a memory-free process {i^ = 1). Similarly, the variance 
will be narrowed in the case where p + q < 1, (i.e. ly < 1). The broadening of a scatter plot is the direct consequence 
of the persistence of a binary state and the occurrence of longer-than-usual runs in the data sequences due to state 
clustering, as Fig. 2 clearly illustrates. 
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FIG. 2: Normalized length of run (averaged over 10 sequences) in a 10,000-unit long computer generated Markovian sequence, 
(a) Circles, p = q = 0.50, memory-free Markovian process; (b) triangles, p = q — 0.88, clustering of states; (c) squares, 
p — q = 0.12, dispersion of states; (d) dotted line: theoretical expectation for memory-free processes, Eq. (|10|) . 

It is expected that, when p = q = 0.5, the number of runs having length m, a„i, i.e. sequences of the same binary 
state occurring at frequency Pn in a sequence of total length n, will be [20| 

a™ = (n - TO - 1) • [p-J{l - p-nT + (1 - Pn) Vn™] (10) 

The variance a of am for long enough sequences is: a = a„i. In Fig. 2 the normalized average number of runs 
(over 10 computer-simulated symmetric Markov sequences, each of length n = 10.000), is plotted against the length 
of run, TO. When the Markovian memory {p = q = 0.88) introduces persistence and clustering of the same binary 
state, the average length of the computer-simulated runs is considerably longer than that of the memory-free case 
(p = q = 0.5). On the contrary, in the anti-persistent case {p = q = 0.12), the average length of runs is shorter than 
that of the memory-free sequences. This result supports that, in the latter condition, the states tend to disperse. The 
simulated Markovian memory- free sequences, on the other hand, behave according to Eq. pU]) . as expected [2^ by 
theory. Estimating the self-transition probabilities {p, q) and the variance factor provides a quantifiable description 
of the Markovian dynamics in natural processes within a diversity of scientific disciplines. 

In the first example that follows, the above analysis will be directly applied on scatter plots referring to anthropo- 
logical data. In the second example the analysis is applied on data recording two-state quantum transitions (QZE), to 
directly estimate the lengthening and shortening of runs of the same binary state. Then through simulations, based 
on the mathematical formulation developed here, it goes on to estimate the Markovian self-transition probabilities. 
From these, information regarding the transitions dynamics will be drawn. 
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EXAMPLES OF THE MARKOV MEMORY MODEL IN NATURAL PROCESSES 



Handedness as a Markov process 



Often in scientific disciplines such as medicine, anthropology, sociology, or psychology the evaluation of evidence 
regarding an effect makes use of scatter plots. On one such occasion within anthropology, a meta-analysis, that merged 
the results of 32 studies, was performed to investigate the strength and consistency of right-handedness in nonhunian 
primates [l^. Fig. 3. This application refers to an even blend of primates raised in the wild as well as in captivity. 
The constructed scatter plot in this study was intended to shed light on questions regarding the consistency of the 
data variability with normal sampling variation and the nature of biases in the reports of statistically significant 
handedness. One could, however, get additional information from these scatter plots, with regard to the internal 
dynamics of the processes involved that lead to handedness preference. 

Anthropologists discovered that chimpanzees develop cultures in the same way as humans do. According to Whiten 
et al. [2^, handedness in nonhuman primates tends to be lateralized. Yet, unlike humans where there is only 10% use 
of left hand, this proportion in nonhuman primates in the wild reaches 50%. Chimps in captivity, however, exhibit a 
weak preference for the use of right hand, which is believed to result from the human influence. These observations 
are in agreement with results of the present Markov analysis. 

We assume that the interactions among the nonhuman primates that influence handedness are driven by a Markovian 
binary process, where preference for the right and left hand is represented by the self-transition probabilities, pn = p 
and P22 = Q, respectively. Surely there exist multiple interactions among the individuals in a group. Yet, as it is 
a common practice in many scientific disciplines, interactions are often reduced to first neighbors, as long as this 
simplification does not distort their true representation. In Fig. 3 the number, n, of significantly-handed individuals 
(pan troglodytes) was plotted against the proportion, pn, of them who were right-handed. The confidence interval 
curves according to Eq. ([7]) that best envelope the 95% of the experimental data are drawn by adjusting the Markov 
memory parameters and are given by 



1 24 

"=fe-0.58)^ ^''^ 

The confidence interval representing data of random variability {v = 1), which implies an equal preference for right 
and left hand use, is also marked on the graph for comparison. It is clearly not fitting adequately the totality of these 
data, apart from these referring to individuals living in the wild. 

The Markov analysis rendered the parameters, p = 0.64, q = 0.50, v ~ 1.15, p = 58% for the individuals in captivity 
and p ^ q ^ 0.50, ly ~ 1, p = 50% for those in the wild (dark circles). The accuracy of the three parameters above 
is limited to 1% and so the parameters are rounded up to the second decimal digit [27|]. It is a known fact that the 
members of a group positively influence each other with regard to handedness. Therefore, the estimated self-transition 
probabilities for either the use of the right or the left hand should be > 0.5. That fact together with the condition 
that the 95% of the data points should be enveloped by the confidence interval curves enables a relatively accurate 
adjustment of the two parameters, p and q, within the limitations of the size of this database. 

The current results can be understood as follows. They first imply that the studied individuals have a tendency 
to use both left and right hands equally, unless they are in captivity (open circles). In that latter case, the human 
infiuence modifies their handedness habits: Therefore, the initial 50% preference for the use of the right hand rises to a 
58% (p = 0.58). This conclusion represents only part of the information available by the Markov memory analysis. As 
it confirms the independent observations in the reference study, one can be relatively confident about the effectiveness, 
reliability and applicability of the Markov approach used. 

Apart from the static average value above, the current Markov analysis provides extra information towards the 
understanding of the chimpanzees interactions. The collective evaluation of independent studies in a meta-analysis 
presupposes that they are all measures of one the same phenomenon within samples of different size. We can, therefore, 
assume that the size of a group of the individuals in captivity can increase for a number of reasons (that do not concern 
the scope of this paper). Every newly added member would take after the handedness habit of the one close to them, 
whether this is a mother, a partner etc, in the following likely scheme. In this representation of handedness habits 
of individuals in captivity by the first-order Markov memory model, there will be a 64% probability that an added 
member of the group will prefer to use their right hand, as the individual close to them does. Also that 36% of them 
will prefer to use their left hand instead, if they are close to a right-handed individual. The use of the left hand 
appears not predisposed by human presence, however. There will be a balanced 50% probability to use either their 
left or right hand if the individual close to them is a left-handed individual. 
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FIG. 3: Scatter plot of a meta-analysis investigating preference in handedness among nonhuman primates [3. Open circles: 
captive, closed circles: individuals in the wild. The 95% confidence interval curves are also plotted (solid curves), Eq. (0, 
suggesting that p = 0.58, p = 0.64 and q = 0.50, v — 1.15 for the totality of the data. Dotted lines: memory-free and symmetric 
Markov process {p = q = 0.50, p — 0.5, ly = 1) best representing individuals in the wild. See text for details. 



The merit of the current Markov analysis, when appUcd on scatter plots, lies on the fact that it provides in one 
graph more information than just the static parameters directly available from other qualified statistical methods. 
Additionally, it offers a quantitative description of the interactions between the studied system units. In that sense, 
the current analysis sheds additional light on the dynamics of the system under study which otherwise constitute 
complicated processes. We showed here that the Markov analysis widens the scope of applicability of scatter plots, 
from mere graphic examinations of the presence of biases in data bases to effective tools for the understanding of the 
interactions among the group units. 



The quantum Zeno effect 

The second example treats a quantum two-state system exhibiting the so-called quantum Zeno effect (QZE) 0,0] i 
that has taken its name from the famous Zeno paradox. In the QZE the natural state transitions can be impeded 
by fast repetitive state-monitoring measurements. Therefore, a series of state measurements will also observe the 
persistence of this preferable state from which transitions have been hindered. Longer runs of that state will be 
recorded in a series of measurements, as Fig. 2 illustrates. Therefore, the persisting state will appear to cluster while 
the state that is avoided will appear to disperse in the sequence of state measurements. The clustering is marked by an 
increased frequency of runs of the same state (triangles in Fig. 2) as compared to the memory-free unhindered situation 
(circles and dotted line in Fig. 2). As the current Markov memory model mathematically handles this clustering and 
dispersing behavior of the two-state system, the QZE represents an attractive candidate for its application. 

Specific details about the experimental settings and the generation of quantum states by Balzer ct al that can be 
found directly in the source paper arc not pertinent to the current analysis. It suffices to mention that in this quantum 
system the transitions between the two-states are driven by the application of an appropriate field. As the system 
evolves in time driven between the two states, it is possible to observe at which state the system is at a certain time 
by the application of a second field, the probe field. The probe field monitors the state of the system. Emission of 
scattered light indicates that the system is at the lower state-1, called 'on' state. Absence of scattered light indicates 
that the system is at the upper state-2 called 'off' state. It was observed that under certain experimental settings 
introducing fast repeated state measurements, the evolution of the quantum system was hindered. The suppression 
of transitions is observed by a clustering of the state that persists, or by the dispersion of the second state, in a long 
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sequence of state measurements. It was documented in the source paper by a graph of the normahzcd frequency 
of "uninterrupted sequences" of state 'on' and state 'off', against the length of the corresponding sequences. The 
degree to which the probing process interacted with the drive field to impede the system's quantum evolution was 
thus estabhshed. 

The Markov memory approach developed in this paper goes a step further to estimate the conditional probabilities 
that determine the readiness of the two-state system to make a transition, or remain at the same state with each 
probing measurement. The frequency of uninterrupted sequences (runs) of states 'on' and 'off' were simulated, by the 
selection of appropriate self-transition probabilities, and fitted on the experimental data. The associated first-order 
Markov self-transition probabilities, pn and P22 thus estimated at each of the three experimental settings employed, 
provide an insight into the state transition dynamics. 




Length of run, m 



FIG. 4: Clustering and dispersion of Markovian states in the quantum Zeno effect. Experimental data for three different 
detuning settings [3, [33|. Open squares: 'on' events, state-1. Dark squares: 'off' events, state-2. Lines: computer simulated 
runs of a two-state Markov memory process, modulated by the self-transition probabilities, pn and P22. See text for details. 

In the first experimental setting, the system starts from state-2 at conditions favoring its persistence. The estimated 
self-transition Markov probabilities were P22 = 0.65 and pn = 0.25, or equivalently P21 = 0.75. The latter probability 
implies that once the system is at state-1 it is very eager to make a transition back to state-2. On the other hand, 
once the system is at state-2 it prefers to remain at it by a 65% probability with every consequative measurement. 
The system therefore, was lead to persistence of the 'off' state-2 due to a combination of two factors: its preference 
to remain at this state combined with the most effective 75% preference to avoid the competing 'on' state-1. This 
analysis shows therefore that a quantum transition is impeded not only because the experimental conditions favor 
that state, but mainly because they obstruct the rival state. Longer runs of state-2 will be observed in that case, Fig. 
4a. 
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There were further two more experimental settings employed in this experiment. The first one, fig. 4c, favors the 
persistence of statc-1. The application of the Markov memory analysis on these data has turned the values pn = 0.80 
and P22 = 0.55. These imply that once the system is at state-1 transitions from it are hindered, because it exhibits 
a strong 80% preference to remain at this state combined with a small 45% tendency to avoid state-2. Unlike in the 
previous experimental setting, here it is mainly the strong preference for state-1 that hinders transitions from it. 

Finally, the third experimental setting brings the quantum system somewhere in between the previous two behaviors, 
fig. 4b. The Markov memory analysis has rendered the values pu = 0.60 and P22 = 0.65. In this case there is an 
equal, yet relatively weak, 60 — 65% preference for the system to remain at either state. The evolution of the system 
from both states is moderately hindered, but the experimental conditions level the competition between the two rival 
states. Thus, the system shows evidence of similarly administered preference, where state-2 is temporarily and mildly 
winning. 

This example shows how the QZE can alternatively be accounted for as a process driven by a Markovian type of 
memory. In that procedure, an insight regarding the inner dynamics of the observed effect is obtained. The agreement 
between simulated and experimentally observed QZE data is very good, especially for frequencies up to about 10"'^. 



SUMMARY 



In this work it is shown how the natural evolution of two-state processes is shaped by the presence of Markovian 
memory in them. The presented mathematical formulation provides an alternative, quantitative as well as qualitative, 
description of a wide interdisciplinary range of processes, classified as two-state systems. The presence of Markov 
memory, |3l| will enhance either the clustering or the dispersion of these binary states. When independent studies of a 



phenomenon are combined and graphically presented in scatter plots, for instance, the clustering of states is recognized 
by a broadening of the associated scatter plot. Conversely, the dispersion of states is marked by a narrowing of the 
scatter plot's breadth. These changes occur for the reason that the Markovian memory has affected the length of runs 
of the same state in the two-state system. Two examples are invoked to exemplify the applicability of the Markov 
memory approach and the kind of prospective information that can be gained from it. The first one is a two-state 
system taken from anthropology, while the second one is taken from quantum theory. 

In the first example, independent studies testing handedness in a mixture of cultures of chimpanzees were shown to 
exhibit Markov memory with regard to how strongly-related individuals may influence each other. Individuals raised 
in the wild exhibit equal preference for the use of both hands, regardless of what is the preference of their closest 
relatives. The presence of humans influences this attitude as far as the use of the right hand is concerned. There was, 
therefore, a mildly increased preference for the use of the right hand assessed to a 64% probability, that the closely 
related individuals exhibit the same preference. There was no similar effect observed in the use of the left hand, 
however. It appears that a new member of the group, closely associating with a left-handed individual will exhibit an 
independent handedness preference. Overall, a proportion of 58% of individuals across the mixture of studied groups, 
both in captivity and in the wild, prefer to use their right hand. These estimated tendencies in handedness, influenced 
by presence of humans, agree with independent anthropological studies, conveying a degree of confidence to them. 

The current Markovian mathematical formulation was also applied on the experimental observation of the quantum 
Zeno effect (QZE) in a two-state system. The experimental evidence in this example exhibits a combination of 
characteristic clustering and dispersion of the binary states, across the three experimental conditions employed by the 
source paper of Balzer ct al. Through simulations of the length of runs in each of the three experimental conditions, 
it was possible to observe that a synchronous clustering of the one state and dispersion of the other can be responsible 
for the characteristic hindering of state transitions. The probabilities that determine the likelihood for the system to 
make one transition to the other state, or remain at the same binary state, were thus estimated. These probabilities 
should not be confused with those estimating the frequency of each state in a long sequence of measurements. It was, 
thus, concluded that the hindering of a binary state in the quantum Zeno effect may be effected not so much by the 
65% preference for state-2 through two consecutive measurements, as through the synchronous avoidance of the rival 
binary state-1, by a 75% probability that the rival state will precede the preferred state. Similarly, the hindering of 
the evolution of state-1 can be effected by a strong 80% preference for that state, winning over a weak preference 55% 
for the rival state. 

The Markov memory analysis of two-state processes presented here treats complicated processes in terms of their 
first-order, first-neighbor interactions. This simplification is an initial step towards the understanding of rather com- 
plex processes that can describe the system and where comparisons are possible, are in agreement with experimental 
evidence. Our understanding of nature builds in steps of gradual complication. Occasionally, simplified versions of 
reality, rather than the more complicated or unattainable ones are tried, as long as their exercise does not confiict 
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with established experimental evidence. 



APPENDIX A 



Following the treatment of von Mises [20| we assume that jp+f/ — 1| ^ 1 excluding the cases p = q = 1 and p = q = 0, 
as they present no interest but < p,q < 1. The following recursion formula holds for the state probabilities 

pf^=Ef..P^""'^ * = 1>2; n^l,2,... (12) 
Equations ([T^ are equivalent to the iteration set up of the following homogeneous equations 

2 

- Xi +'^PijXj = 0, i ^ 1,2 (13) 

The sum of transition probabilities of each column is equal to 1. Also the absolute probabilities at every step of 
the system's evolution sum up to unity 

2 

J2p^j = 1 (14) 

E^i" = E^r' = i (15) 

Since the 2x2 transition matrix having elements pij i,j ~ 1,2 is regular, tends to a unique fixed probability 
vector that can be estimated by solving the system of Eqs. p^ . These lead to two non-zero solutions u and 
1 — u, to which the probabilities p„ and 1 — Pn converge after a large number of trials, n. The two roots of system 
(17) are the values A for which its determinant |f'(A)| vanishes 



l^(A)| 



p- X 1-q 
1-p q- X 



= (16) 



where A cannot be greater than 1 in absolute value. In this case the two roots are 

Xi=p + q-l 

A2 = 1 (17) 

The equations p2p . and p7p . can then be written as 

ui ^ p ■ ui + {1 - q) ■ U2 



U2 = [l - p) ■ Ui + q - U2 

yielding the two not uniquely determined solutions u and 1 — u 



(18) 
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Equations (jl9p have an important consequence. The probabihtics of finding the system at either binary state after 
n trials converge to p = 50%, provided the two self-transition probabilities are equal, p ~ q, and regardless if they 
are different from 50%. In other words, in the long run binary states (A and B) will occur in the Markov chain at 
the same frequency as if no memory was involved. From the point of view of long-run state probabilities the Markov 
process will resemble a memorylcss Bernoulli case. We shall next estimate the frequency of state A. 

As stated in the text, the number ~ I is associated with the occurrence of state A after a measurement and 
a;,y = is associated with the occurrence of state B. The expectation value of x,^, i.e. Pi, , will be the probability that 
the outcome of the v*^ measurement will be the number 1. The expectation value of all the '1' states present in a 
Markov sequence of n trials will be then 

E[xi + X2 + ... + Xn] = P1+P2 + ■■■ +Pn (20) 

and the expected value of proportion of ones in the chain in will be 

X P1+P2 + ■■■+Pn _ 
E[-] = pn (21) 

n n 

The recursion formula (16) can be written 

2 

PijPj -PiiPi +P12P2 -a-pn+i+b (22) 

j=i 

where a = p + q — I ^ 1, and b = 1 — q since < p < 1 and < q < 1. Given that the initial value of p„ is pf'^ = pi 
, the recursion formula (26) yields [s^l 

1 — r?""^ 

Pn = a^n - l)pi + a"-2 + a"-^ + ... + a + 1 ■ 6 = a"" Vi + b (23) 

V ' 1 — a 

{n—l)terms 

or 



P. = - ^^(^ + j^j^^ = ."-M.. - P] + P (24) 

where p is defined in (23). The average expected proportion of state A, p„, in the chain of n trials would be written 
as fH 



1 



/ ^ 1 



(Pl + P2 + ■■ + Pn) ^ P + 



Pi - P 1 



(25) 



and 



P 



(26) 



The absolute probability of finding the system at state A after n measurements of its state is written p " = p„ and 
the probability of finding it at state B is pj""* = ^ ^Pn- This is equivalent to saying that the n-th measurement of the 
system's state has a probability p„ of finding it at state A. Since p^"' = pj"'' and q^"' — Pi2 the recursion formula 
(16) applies to the transition probabilities between states too 
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gf") =a-g("-^) +6 (27) 
The recursion formula then yields, since p^ii — 1 and = 

1 — o" 

= a>(°) + + a""2 + ... + a + 1] . 6 = a" + . = . [i _ p] + p (28) 
^ ' 1 - a 

n terms 

and 

= a"g(°) + [a"-i + a"-^ + ... + a + i] . {, = a" ■ [1 - p] (29) 
" V ' 

n terms 

If the system is at state A the probability that after n steps, where n is very large, the measurement will yield 
again state A is p: p*-"^ p and to yield state B is zero g*^"^ 0. 

n — >oo n — 'oo 

Von Mises has estimated the standard deviation of the mean value p, in other words, the asymptotic value of the 
standard deviation of the proportion of state A, pn, in the sequence of n trials as 



The proportion of state A in sequences of trials of length n of a Markov process with memory scatters about the 
asymptotic value p , while their scatter has been modulated with respect to the memory-less case 



The modulating variance factor in (34) 



cr„ = 



P(l^ (31) 



^ (32) 

1 — a 

takes values either above or below 1 depending on the self transition probabilities according to 

v<l^p + q<0.h (33) 
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